Sorting / scanning system camera upgrade apparatus with backwards compatibility

ABSTRACT

A scanning camera upgrade adaptor system provides backwards compatibility when an existing scanning camera subsystem is replaced or upgraded in automated sorting equipment with a newer camera having a different data format. The adaptor system allows sorting equipment such as mail sorting equipment to be upgraded or repaired with a new camera while providing compatibility and optional fallback to a previous mode of operation of the existing equipment. The upgrade system enables legacy equipment and newly added sorting/processing equipment to be utilized in conjunction, while reducing cost of upgrade and necessity for completely new equipment as desirable features are added.

CROSS REFERENCE TO RELATED APPLICATIONS

REFERENCE TO U.S. PROVISIONAL PATENT APPLICATION 61/551,174 Filed Oct.25, 2011

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

NONE

THE NAMES OF PARTIES TO A JOINT RESEARCH AGREEMENT

NONE

INCORPORATION-BY-REFERENCE OF MATERIAL SUBMITTED ON A COMPACT DISC

NONE

This application claims priority to a U.S. Provisional PatentApplication 61/551,174 Filed Oct. 25, 2011 titled “SORTING/SCANNINGSYSTEM CAMERA UPGRADE APPARATUS WITH BACKWARDS COMPATIBILITY” with firstnamed inventor David Lowell Bowne, La Crosse, Wis. (US), which isexpressly incorporated herein as though set forth in full.

BACKGROUND OF THE INVENTION

The present invention relates generally to mail processing, and moreparticularly to a method, system and program product for providingbackwards compatibility when replacing a camera subsystem with a newercamera subsystem in standard automated mail sorting equipment such as aMulti-Line Optical Character Recognition (MLOCR) mail sorter.

As automated mail sorting equipment ages the need to replace keycomponents that may have become obsolete or reached the end of theiruseful life becomes a potential issue. One such component is the camerasubsystem that is used to scan images of mail items. A camera subsystemtypically connects to various other components of the mail sortingequipment such as the tachometer, the system control computer and theimage processing subsystem etc. Replacing a camera subsystem, or justthe camera with an equivalent model may not be possible or may be veryexpensive, because an equivalent subsystem, or an exact replacementmodel camera may not be available. In any sorting system utilizing acamera, the camera is a key component of the system and may serve as thebasis for all sorting by the machine, with the camera utilized inperforming address recognition, bar code recognition, or otherprocessing based upon an image of the item to be sorted as “seen”through the lens of the camera, and then captured in digital form fordigital processing.

BRIEF SUMMARY OF THE INVENTION

Directly replacing an obsolete, aging, or broken camera subsystem insorting equipment with a new camera subsystem may not be possible, ormay become a costly proposition because of lack of compatibility of newcamera components with the rest of the components that are already inplace in the sorting equipment. Newly available cameras may typicallyprovide higher resolution images than older cameras, and may alsopresent data in a different analog or digital format, or utilizedifferent physical connectors, or use electrical signals in a differentway, at different voltage or current levels, or may differ in many waysthat would be well known or understandable to one familiar or skilled inthe art of electronics and/or video cameras.

The present invention in several illustrated embodiments is directedtowards replacing a “legacy” (original equipment) camera subsystem witha new camera or camera subsystem, and adapting the new camera to work inthe legacy (old) environment.

Such replacement when utilizing a new higher resolution camera withpossibly better optics or lighting or other improvements may for examplefurther provide for better images, improved recognition of addresses orbar codes, improved speed of processing, or other similar and generalimprovements.

It is therefore an advantage to provide a method and/or apparatus thatallows for replacing a camera subsystem of standard sorting equipment,such as mail sorting equipment with newer camera technology, or adifferent model camera while continuing to allow for and to providespecifically for utilization of significant portions or even all of theolder equipment and subsystems within the sorting system. Installationof a new camera may further enable improving the performance, and/oradding features and other equipment to the original sorting system.

For example, a higher resolution camera may provide for improvedrecognition of written, encoded, or printed addresses, or allow for useof better or alternative algorithms for recognizing written, encoded, orprinted addresses on a mail item being sorted.

Introduction of a new technology into a complex system such as mailsorting equipment may present a risk of impacting the current (legacy)operation and/or algorithms of the equipment. Accordingly, a furtheradvantage of the method and apparatus of the present invention isminimizing the impact of introducing such new camera technology intosuch sorting equipment, and for allowing for fallback utilizing legacypieces of an existing piece of sorting equipment in the event of failureor incorrect operation of new equipment installed in the sorting systembeyond that of the camera itself.

The current or prior art mode of operation includes processing images ofmail items captured with a legacy camera at an existing resolution, 212dots per inch (dpi) (for example). These will be referred to as “legacyimages” and are handled by the same legacy components that already existin the standard mail sorting equipment.

In the same context, the new mode of operation includes processingimages of mail items captured with a new camera, typically at a higherresolution, 256 dpi or higher, for example, and also allowing for a newcamera with the same resolution as the old, but with possibly adifferent format for output of scan or video data. These will bereferred to as “high resolution images” and are handled by a new set orgroup of components that are added to the standard mail sortingequipment. It will be appreciated that both modes of operation utilizedby such mail sorting equipment share the same goal: processing images ofmail items to automatically read the mailing address and sort the itemsaccordingly. The new mode of operation provides higher performance bytaking advantage of higher resolution images and a new set of componentsthat provide additional functionality such as multiple binarizationalgorithms, more accurate region of interest detectors, etc.

Accordingly, the method and/or apparatus the present invention fulfillsthe need for minimizing the impact of replacing legacy camera technologywith newer technology achieved by providing backwards compatibility withexisting equipment and system programming. In addition, furtherillustrated embodiments of the method and/or apparatus may also providefor improved performance in operation of a sorting machine whileallowing for reduction in cost of an upgrade by utilizing existingcomponents.

Additionally, the method and apparatus of the present invention allowsstandard mail sorting equipment to fall or revert back to its previousmode of operation in the event of a failure in the newer camerasubsystem during operation. That is, where newer features or equipmentwere added during a camera or camera subsystem upgrade, these featuresand/or operation of the new equipment could be disabled in case ofproblems, thus allowing the sorting equipment to revert to a prior modeof operation while still utilizing the new camera or camera subsystem,this prior mode possibly affording better reliability, testing, orcompatibility with prior operation and/or other equipment. The methodand apparatus of the invention described herein according to oneillustrated embodiment relies on the addition of a new camera systemincluding or being connected to an adaptor card apparatus in a mannerwherein the new camera system provides as outputs both “legacy images”and “high resolution images”. As described herein, the adaptor cardapparatus of the illustrated embodiment may be implemented as a printedcircuit board (PCB) having one (1) input connection such as CamLink orGigabit Ethernet connected to a new high resolution camera and two (2)output connections, one connected to the new components of the mailsorting equipment in the form of a pass-through connection such asCamLink or Gigabit Ethernet carrying “high resolution images” and asecond output connection to the legacy components of the mail sortingequipment, and utilizing the same format and optionally the connectionmechanism as previously utilized. In at least one embodiment, the outputconnection may take the form of a connection such as Low-voltageDifferential Signaling (LVDS) used for carrying “legacy images”. Theadaptor card apparatus of the illustrated embodiment, utilizing dualimage data paths, is able to provide backwards compatibility with thelegacy components as well as optional connection to the newer componentsor equipment while providing a fall back mechanism in the event of afailure occurring in the new components.

In addition, a further illustrated embodiment of the method andapparatus of the present invention described herein also includes amechanism or arrangement for synchronizing and pairing a “legacy image”with its “high resolution image” counterpart when both images arereceived by the new components during the new mode of operation. A“legacy image” may carry important information, such as the mail itemidentification tag or (i.e. a unique tag that automated mail sortingequipment creates to track each mail item during processing), which canonly be provided by the legacy image processing subsystem components.Therefore, this information is not readily available to its “highresolution image” counterpart since this high resolution image bypassesthe standard processing step performed by the legacy components. Imagesprocessed by the “legacy” equipment and programming may not produce thesame number of output “files” or data and/or the data may come out ofthe legacy system equipment and the legacy program process may occur ina different order than which it went in. Therefore, there is need forthe new components to provide a mechanism or arrangement forsynchronizing or associating these image pairs in order to obtain thepotentially very much needed information from the “legacy image”. Thesynchronization and pairing method and mechanism of this furtherillustrated embodiment thus provides backwards compatibility with thelegacy components since information such as the mail item identificationtag may be essential in completing the sorting of a mail item, and thiscapability may not be provided by the new camera subsystem in equivalentform or in the same sequence.

The synchronization method which pairs a legacy image with its highresolution image is included in the further illustrated embodiment forthose situations where capture, processing, and storage of the legacyimage may occur independently of the capture, processing, and storage ofthe high resolution image. For example, mail items scanned by the legacysystem may not result in production of a legacy images for every mailitem, and legacy images may not be produced in the same order as themail items are scanned. Thus, this further illustrated embodiment of themethod and apparatus of the present invention provides an alternativemechanism for relating or associating each legacy image with a highresolution image.

As discussed above and in greater detail herein, according to one ormore illustrated embodiments of the method and apparatus of the presentinvention, automated mail sorting equipment is able to be upgraded witha new camera subsystem that includes a new camera and an adaptor cardapparatus. According to the teachings of the present invention, as partof this upgrade, automated mail sorting equipment is also outfitted witha new set of components that include new image processing subsystemcomponents to take advantage of the features provided by the new camerasubsystem, such as higher resolution images. During the upgrade, theinput port of the adaptor card is connected to the new camera via aninterface connection such as CamLink or Gigabit Ethernet. One of theoutput ports of the adaptor card is connected to the legacy imageprocessing subsystem components via an interface such as LVDS. Thesecond output port of the adaptor card apparatus is also connected tothe new image processing subsystem components via an interfaceconnection such as CamLink or Gigabit Ethernet. In this configuration ofthe illustrated embodiment, the adaptor card apparatus receives “highresolution images” from the new camera subsystem and transmits these“high resolution images” to the new image processing subsystemcomponents. In parallel, the adaptor card apparatus “down-samples”(converts) the “high resolution images” received from the new camerasubsystem to a resolution that matches the image resolution of thelegacy camera subsystem being replaced, thus converting them into“legacy images”, and transmits those “legacy images” to the legacy imageprocessing subsystem components. The adaptor card apparatus receives asingle high resolution image data stream from the new camera subsystemand generates two image data streams from it, a low resolution streamthereby maintaining compatibility with the legacy components and a highresolution stream to support the operation of the new components.

During operation before a “legacy image” is sent to the legacycomponents, the adaptor card apparatus of the illustrated embodimentencodes a unique image identification number into a digital signature,such as a barcode format such as a 2-state, 4-state or any other linearor two dimensional barcode symbology and superimposes the digitalsignature on an area of the “legacy image”, such as the lower rightcorner, the right edge or a combination thereof, that is likely tominimize obstructing or overwriting important mail item information. Inthe case of a linear barcode, such barcode can be superimposedvertically (in a “ladder-like” fashion), horizontally (in a “picketfence-like” fashion) or both. The selected digital signature is designedto optimize its chances of surviving the image processing operationssuch as binarization or cropping that are typically performed by thelegacy image processing subsystem components. For example, if the barsof a barcode are designed too thin or too short they may get interpretedas background noise and removed during the image binarization operation(i.e. when an image is converted from color or gray-scale to black andwhite). The reason for including both a vertical and a horizontal copyof a linear barcode is to minimize the chances of the legacy imageprocessing subsystem components obliterating or partially removing thebarcode.

Likewise, before a “high resolution image” is sent to the newcomponents, the adaptor card apparatus encodes into the first few bytesof the “high resolution image”, using an alphanumeric characterrepresentation system such as American Standard Code for InformationInterchange (ASCII), the same unique image identification number thatwas used to encode the digital signature of its “legacy image”counterpart. Since a “high resolution image” is not processed by thelegacy image processing subsystem components there is no danger of thelegacy binarization task or operation removing the alphanumericcharacters. In this case, the new image processing subsystem componentsare designed or implemented to recognize “high resolution images” andextract the unique image identification number from the images beforethey are converted from color or gray-scale to black and white. It willbe recognized by those skilled in the art that other methods forencoding and extracting a unique image identification number could bedevised.

From the above, it is seen that the upgraded automated mail sortingequipment is thus able to operate in two modes. One mode, referred asthe “new mode of operation”, takes full advantage of the new camerasubsystem as well as the new set or group of components added to thestandard mail sorting system to process the images and sort the mailitems. The other mode, referred as the “fallback mode of operation”, or“legacy operation”, incorporates and utilizes the new camera subsystem,but still utilizes or relies on “original” legacy components to processthe images and sort the mail items.

Under and during the “new mode of operation”, the new camera subsystemof the illustrated embodiment transmits “legacy images” to the legacyimage processing subsystem components for processing and “highresolution images” to the new image processing subsystem components forprocessing. The tasks performed by the legacy components may include abinarization step to convert the image from color or gray-scale to blackand white. When the automated mail sorting equipment is operating inthis mode, the new set of components receive from the legacy componentsthe “legacy images” including any available important information suchas the mail item identification tag. Likewise, the new components alsoreceive directly from the adaptor card apparatus the “high resolutionimages”. A major task or operation/function performed by the new set ofcomponents includes processing “legacy images” to locate and read thedigital signature that was superimposed on the images by the adaptorcard apparatus. The purpose of this digital signature reading task is todecode the unique image identification number associated with eachimage. Another major task or operation performed by the new set or groupof components includes processing “high resolution images” to extractfrom them the unique image identification number that was encoded in thefirst few bytes of each image by the adaptor card apparatus. Next, animage pairing task or operation performed by the adapter card apparatusutilizes the information read from the digital signature of “legacyimages” and the information extracted from the first few bytes of “highresolution images” to associate or relate pairs of low and highresolution images that correspond to the same sorted physical mail item.Once the image pairs are associated, all the information about the imagethat was available only to the “legacy images” is also now madeavailable to the “high resolution images”. Therefore, the adapter cardapparatus is able to associate an important piece of information such asthe mail item identification tag with the “high resolution image” and bemade known during the subsequent processing of this image. This enablesthe adapter card apparatus to successfully sort a mail item using thenew “high resolution image”. Under the “new mode of operation” standardautomated mail sorting equipment has the option of utilizing eitherimage (i.e. “legacy” or “high resolution”) during the subsequent sortingprocess.

In a still further illustrated embodiment of the method and apparatus ofthe present invention, the “fallback mode of operating” is invoked whena failure is detected in any of the new set of components that canprevent the system from using “high resolution images” and the new setof components to successfully sort mail items. In this mode, the mailsorting system reverts back to only utilizing “legacy images” and legacycomponents to sort mail items. That is, when this happens, the new setof components and the “high resolution images” are not utilized.Instead, the legacy components utilize or rely on the “legacy images”that they receive from the adaptor card to complete or perform the taskor operation of sorting mail items. The “legacy images” containeverything that is needed to successfully sort in this mode ofoperation. There is no need to decode the unique image identificationnumber from the digital signature that was superimposed on “legacyimages” by the adaptor card apparatus since it is no longer necessary topair “legacy images” with “high resolution images”. In fact, the onlydifference between this mode of operating and the legacy mode ofoperation (i.e. before the upgrade took place) is that the “legacyimages” are now being provided by a new camera subsystem that willlikely show improved performance from higher quality optics, betterillumination, larger field of view, etc. Therefore, even when theupgraded system falls back to a legacy mode of operation, the standardmail sorting equipment still can provide the benefits obtained fromutilizing a better camera subsystem.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

The invention is better understood by reading the detailed descriptionof the invention in conjunction with the accompanying drawings:

FIG. 1 illustrates typical Mail Sorter Equipment of the prior art;

FIG. 2 illustrates Mail Sorting Equipment upgraded utilizing apparatusand/or method according to at least one illustrated embodiment of thepresent invention;

FIG. 3 illustrates upgraded Mail Sorting Equipment according to one ormore embodiments including image stamp and image correlation apparatusand/or method for relating legacy images with images at a secondresolution;

FIG. 4 illustrates an arrangement of upgraded Mail Sorting Equipmentaccording to the present invention including image stamp and imagecorrelation apparatus and/or method for relating legacy images withimages at a second resolution, with the pairing of legacy images andimages at the second resolution performed in an alternativearrangement/ordering of the system;

FIG. 5 illustrates the “tagging” or “stamping” of a legacy imageillustrated at 212 dpi with a POSTNET Barcode for correlation with acorresponding higher resolution image as illustrated in FIG. 6;

FIG. 6 illustrates a 256 dpi image taken with the new higher resolutioncamera and marked with an image identification code, for correlationwith a corresponding lower resolution image as illustrated in FIG. 5according to the teachings of the present invention; and,

FIG. 7 illustrates the relating of legacy images to high resolutionimages utilizing an image id tag that is embedded within a legacy imageaccording to the teachings of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 illustrates typical mail sorting equipment 100. Mail Items 120 tobe scanned for sorting are passed in front of a camera 110 in a steplabeled Mail Item Scan 121. The camera provides image data 130 to imagedata processing equipment 150, the image data processing equipment alsooptionally serving to utilize the camera with a camera controlsinterface 140 as necessary to capture images from the camera. The imagedata processing equipment 150 utilizes the images captured from thecamera and sends signals 160 to one or more sorting apparatus 170.Sorted mail items 123 are illustrated as leaving the sorting apparatus,and optional data regarding the mail items and/or the sortingprocess/results is labeled as Mail Item Legacy Data 180.

FIG. 2 illustrates an “upgraded” mail sorter 200 in at least oneillustrated embodiment of the present invention. The “legacy” camera 110of FIG. 1 is replaced with a new model camera 210, which scans mailitems or takes pictures of mail items at a higher resolution or with adifferent output format than the legacy camera. For example, the newmodel camera takes pictures at a resolution of 256 dots per inch (dpi),or greater, and replaces the legacy camera which took pictures at 212dpi. The higher resolution may provide for potentially betterrecognition and processing of addresses written on the mail item andcaptured during the mail item scan 221. The higher resolution image fromthe camera 231 may not however be compatible in terms of resolution orsignal type or connector styling with the existing (legacy) equipment.Therefore, in order to maintain utilization of other “legacy” componentsin the sorting machine, it is an advantage of the present invention toprovide for hardware and control to provide adapted controls and signalsto replace those controls and signals previously associated with thelegacy camera. That is, it is an advantage to provide an adaptorapparatus 201 that translates the format and connections of the newmodel camera 210 to a format and connections compatible with thosepreviously provided 140 by the “old” or legacy camera, and after theupdate those new signals and controls 240 will replace those previouslyconnected to the legacy camera, but will be in the same format andutilize the same hardware connection 140 as those utilized, before theupdate, for connection to the “rest” of the sorting machinery.

With further reference to FIG. 2, signals at a higher resolution oralternate format 231 than the original signals from the old or legacy”camera (reference 131 in FIG. 1) are processed by an image formatconversions apparatus 241, reduced in resolution to the original“legacy” resolution (if needed), and provided as a signal in theoriginal legacy format (and optionally resolution) 230. Depending onpossible differences between the camera being replaced and the newcamera, conversion of one or more control signals 242 from “new”controls or new control formats 241 to “legacy controls” or legacycontrol format 240 may also optionally be provided, or be necessary.

The upgrade adaptor 201 thus provides as output from the image formatconversion 241 signals at the legacy resolution and format forconnection 130 to the legacy image data processing equipment 150(already in place). The connection 140 of adapted controls 240 is alsoprovided, if necessary to the legacy image data processing equipment150. The legacy image data processing equipment 150 then providessorting controls 160 to the legacy mechanical sorting apparatus 160which sorts scanned mail items 122 and provides sorted mail items 123.

It also may or may not be advantageous to provide for some processing ofthe new resolution higher resolution image 231 in parallel with theimage format conversion before the image is transmitted as a higherresolution signal 232 to new image data processing equipment 250. Newimage data processing equipment provides new mail item data 280. In oneor more embodiments, new processing of the higher resolution image datais provided for potential improvement in speed or accuracy indevelopment of the sorting controls.

FIG. 3 illustrates Mail Sorting Equipment that has been upgraded with anew higher resolution camera and which further includes apparatus,controls, and or control programming which creates an image stamp andrelated image correlation data for tracking and relating a specificlegacy (low resolution) image with a high resolution image. Thisprovides a means for relating low resolution “legacy” images with one ormore high resolution images of a mail item in order to relate thoseimages after they emerge from two separate paths of processing. This isnecessary since images may or may not emerge from processing elements inthe order in which they entered, and also because the legacy dataprocessing may not provide any means of identifying specific images in amanner that relates them to an incoming order.

The Machine Interface Module 380/Open Recognition Controller 381/OpenRecognition System 382 (MIM/ORC/ORS) box, in general terms, functions soas to receive images and returns sorting results 390 (i.e., where themail piece should be sorted to). The MIM/ORC/ORS box may optionallysupport a plurality of mail sorters at a site and typically connects tothem over a TCP/IP connection. The MIM/ORC/ORS box provides forconnection to both “legacy” Address Recognition System 372/VideoController Unit (ARS, VCCU) and “new” components (OIPS 351) on each mailsorter.

FIG. 4 illustrates of an alternative arrangement of components inanother illustrated embodiment of the present invention. In FIG. 4 thepairing or correlation (or relating) of legacy images and “new” images(higher resolution images) is done as part of the apparatus and controllabeled Open Image Processing System 451, which is somewhat differentthan the Open Image Processing System 351 of FIG. 3. In the arrangementillustrated in FIG. 4, the legacy images are paired immediately afterlegacy Address Recognition utilizing the same information normally sentto the Video Controller Unit 373, with the information captured from theTCP/IP connection between the ARS and VCCU with a TCP/IP “sniffer”. Thisallows paired binary images 455 to be sent to the MIM/ORC/ORS381/382/483 apparatus and controls with the ORS (Open RecognitionSystem) 483 in this arrangement not required to perform the Image IDcorrelation.

FIG. 5 provides illustration of an exemplary PostNet Barcode 520 and inexpanded form 521. This is an exemplary encoding provided asillustration of a stamped image placed at a location on the “legacy”image of a mail item, that is, added to the legacy image in anunobtrusive or non-interfering location. In this example the PostNetBarcode is 428 pixels by 16 pixels 520, and is placed in the lower rightcorner of the legacy image after capture of the image by the new cameraand also after (or during) conversion of the high resolution capturedimage to the legacy resolution. The individual pixels of an exemplaryPostNet Barcode are shown for three of the “bars” 522, 523, and 524 ofthe BarCode. This barcode is later used to relate the legacy images tothe original high resolution images, after the legacy images haveproceeded through any legacy processing.

FIG. 6 provides illustration of a digital ID 620 added to a highresolution image 600 at an exemplary resolution of 256 dots per inch.The digital id added to the high resolution image provides one exemplarymethod of identifying a high resolution image and then relating it to alow resolution “legacy” image as illustrated in FIG. 5. The digital ID620 is illustrated in FIG. 6 as being decoded to a numeric value of“30:31:34:35:36:37:38:39:30”. The digital ID is exemplary and othermethods of relating or identifying a high resolution image to anidentifying number or name could be devised by one skilled in the art ofcomputer programming, or sorting machine design.

FIG. 7 illustrates, as part of an illustrated embodiment of the presentinvention, the relating of legacy images to high resolution imagesutilizing an image id tag that is embedded within a legacy image, withthe image id tag being recognized and associated with one or more highresolution images by that tag. A plurality of legacy images 375 isillustrated with several specific legacy images 710, 711, 712, 713, and714 depicted as being processed by the Open Recognition System (ORS)483. Each of the legacy images 710-714 has embedded in the image animage id tag, which in this example is a number that can be used toidentify and relate from a plurality of high resolution images 232specific high resolution images 720, 721, 722, 723, and 724 those imagesassociated or related to each specific legacy image.

This illustrated embodiment of the present invention deals with twodifferent ID tags. One set of ID tags could be called “image ID tags”and these are used to pair and synchronize the images. The other ID tagcould be referred to as a “mail ID tag” and this tag is created by thelegacy data processing equipment and is used to uniquely identify a mailpiece. For example, an “image ID tag” of 014567890 allows us toassociate a legacy image to multiple new images and all those imageswould essentially represent scans of “mail ID tag” 1230000012. The onlyway for a new image to obtain this “mail ID tag” is to get it from itslegacy image counterpart (it is part of the legacy image data packet).

In this example, legacy image 710 is found to be associated with highresolution image 720. The high resolution images 720-724 are depicted as“entering” the Open Recognition System in a different order than thelegacy images 710-714. The Open Recognition System uses the ID tag tofind the relation between new images (high resolution) and legacy imagesby finding those with the same ID tag. That is, when the legacy imagesare “stamped” with an embedded ID tag, the new images are tagged in thesame way so that the new image in some way identifies itself as beingassociated with the ID tag. This can be, for example, by a file namingconvention, by utilizing a database that associates information witheach high resolution file or other ways that might be readily determinedby one skilled in the art of computer programming or sorting systemdesign.

Because of the new components with higher resolution image, andoptionally better binarization, and algorithms, the MIM/ORC/ORS is ableto derive more and more accurate sorting results while still providingfor usability within existing mail sorting equipment, and providing forpotentially much lower cost in upgrading a system by allowing legacycomponents to continue to be utilized.

The new camera system typically may further provide better illumination(LED versus halogen) generating cleaner images as well as higherresolution images.

The OIPS not only benefits from receiving higher resolution images fromthe camera, but it also generates multiple and better binarized images.The legacy components (ARS), on the other hand, typically had only onebinarizer and had trouble processing certain types of images (because itwould run out of time).

Therefore, the MIM/ORC/ORS box, after the upgrade, will receive cleanerand better binarized images from the OIPS. The MIM/ORC/ORS may alsostill receive legacy images and has the option of using those if needed.

In an illustrated embodiment of the present invention the approachprovides for leveraging all existing technology and allowing forintroduction of a new camera and processing components in a parallelflow of higher resolution images, captured with the new camera usingbetter illumination and binarized with updated state-of-the-artbinarization engines.

In at least one embodiment, a new camera interfaces to a translatordevice that receives a Camera Link® 256 DPI gray-scale video streaminput from the new camera and passes this native input through to anOpen Image Processing System (OIPS). At the same time, the translatoralso down-samples and normalizes the received input feeding a 212 DPIgray-scale video stream to the existing LVDS Frame Grabber maintainingthe current data rates.

The translator functions in a dual role. It receives a Camera Link®input from the new camera and passes through this native input to theOIPS computer. In addition, it translates the Camera Link® input to thelegacy LVDS input required by the existing (legacy) frame grabber, whilemaintaining current image resolution (212 DPI) and data rates. Since theTranslator is feeding two versions of the same gray-scale image receivedfrom the Camera to two different systems, these images must be properlytagged so that they can be associated and synchronized. It is importantto highlight in this illustrated embodiment that the translator uniquelystamps every image before it is fed to the “legacy” Frame Grabber and tothe “new” OIPS. This technique allows the Open Recognition System (ORS)to correlate the binarized images after they are received on its end.This correlation provides for association of one or more high-resolutionimages with the ID Tag that is assigned to the low-resolution image.Once the legacy and new images have been correlated and the ID tags fromthe legacy images have been associated with the new images, the legacyimages may be discarded by the ORS. Alternatively, legacy binary imagescan be used in a waterfall model if it is found that they contribute tothe improvement of the overall recognition rate.

The translator adds a manufactured 16 scan (pixels) wide image snippetto the beginning of every gray-scale image after it is down-sampled to212 dpi. This digital ID will contain 9 digits encoded in a POSTNET orsimilar barcode. Using for example a POSTNET barcode, the ID consists of9 digits+1 check digit, or 50 bars+2 frame bars (leading & trailing longbars). The 9-digit ID contains (for example): a 3 digit MLOCR ID, and a6 digit mail piece identification number. In the exemplary case of aPOSTNET barcode, the manufactured image snippet consists of: a bottomborder (8 white pixels thick), left and right borders (4 white pixelswide), and, 52 short or long bars and spaces in between, as follows: ashort bar—4×4 black pixels, a long bar—4×8 black pixels, and a space—4×8white pixels.

The Translator board tags new images in the 256 dpi form with a digitalID by encoding a 9-digit ASCII value within the first few bytes of a256-dpi image. The first two digits will represent the MLOCR ID and theremaining seven digits will uniquely identify the mail piece, as shownin FIG. 6.

In another illustrated embodiment of the present invention, upgrading ofthe legacy camera with a new camera also enables and provides for addingmultiple and improved binarizers as part of the new image processingequipment. The reason for using multiple binarizers or sometimes usingmultiple instances of the same binarizer with different configurationsettings is to take advantage of the overlap in performance that theymay provide. For example, some binarizers are better at binarizingChristmas mail (possibly with red or green envelopes for example) thanothers. Other binarizers are better at binarizing windowed envelopes. Inaddition, different binarizers crop images differently as well. Some dobetter with handwritten characters. By having several binarized imagesof the same mail piece available, a system can try one image first andswitch to a different image if the first one did not yield any results.All binarizers inside the new image processing equipment would typicallywork from the same input high resolution image. The legacy binarizerinside the legacy ARS will only work on the low resolution image, andtherefore the introduction of a new high resolution camera in place of alow resolution camera provides for potentially improved sorting by theuse of multiple binarizers working on the high resolution image.

The output of a binarizer is always a “binary” image (black and white),but the content of the binary file will vary based on what the algorithmdid to the input image. In some cases the binarization effect is evennoticeable to the naked eye if one were to display the various versionsof the binarized images on a computer monitor. A legacy binarizer may beslow and limited by the CPU performance of the legacy computer it runson. Because of this, there may be images that only get partiallybinarized, potentially truncating the address block. Those images willresult in mail pieces being rejected by the sorter. The presentinvention enables adding improvements to the image processing hardwareand software by allowing both high and low resolution images bynew/legacy equipment (respectively) and in parallel, and also to utilizeimproved processor speeds that were not available when the legacyequipment was designed. This potentially enables the binarizers insidethe new image processing equipment to perform much faster, which isbetter, and in addition to have the advantage of working on a betterinput image.

It is to be understood that the above description is intended to beillustrative, and not restrictive. Many other embodiments will beapparent to those of skill in the art upon reading and understanding theabove description. It should be noted that embodiments discussed indifferent portions of the description or referred to in differentdrawings can be combined to form additional embodiments of the presentapplication. The scope of the invention should, therefore, be determinedwith reference to the appended claims, along with the full scope ofequivalents to which such claims are entitled.

What is claimed is:
 1. A scanning system adaptor apparatus for use inrepairing or upgrading a scanning and sorting system by replacing alegacy camera originally within the scanning and sorting system with anew higher resolution camera, the scanning and sorting system useful forperforming a sorting task such as the scanning and sorting a largeplurality of items to be scanned and sorted, each item with an addresslabel that is utilized as a basis for order of the sorting, the sortingequipment including legacy image processing equipment for processinglegacy format images sent from the legacy camera in a legacy data formatand resolution, the scanning system adaptor apparatus comprising: a) afirst connector providing for connection of the new higher resolutioncamera to the adaptor apparatus and for providing through thisconnection higher resolution image data from the new higher resolutioncamera to the adaptor apparatus; c) an image format conversion apparatusfor converting the higher resolution image data received from the newhigher resolution camera into reduced resolution legacy compatibleimages, the format of the reduced resolution compatible images beingcompatible for processing by the legacy image data processing equipment;and, c) a second connector for connection of the adaptor apparatus tothe legacy image processing system and enabling sending of the reducedresolution legacy compatible images from the adaptor apparatus to thelegacy image processing system.
 2. The apparatus of claim 1 wherein thescanning system adaptor apparatus further includes an image stampingapparatus that generates and embeds within the reduced resolution legacycompatible images an image identification tag that uniquely identifieseach of these images in relation to each of the items being scanned andsorted.
 3. The apparatus of claim 1 wherein the scanning system adaptorapparatus further includes a third connector that provides higherresolution output data that is directly related or equivalent to thehigher resolution image data received from the higher resolution camera.4. The apparatus of claim 1 wherein the system adaptor apparatus furtherincludes a third connector for providing as output from the systemadaptor apparatus, the captured higher resolution images of scannedinput items.
 5. The apparatus of claim 2 wherein the scanning systemadaptor apparatus further comprises: a) tag generating apparatus thatgenerates a plurality of higher resolution image identification tagsthat relate or associate one or more of the plurality of the higherresolution images with corresponding one or more of the legacycompatible digital images, each legacy compatible digital imageincluding an embedded low resolution image identification tag; and, b)one or more further connectors connected to provide as output, thecaptured higher resolution images of scanned input items, and theirhigher resolution image identification tags received from the taggenerating apparatus.
 6. The scanning system adaptor apparatus of claim2 further including a mechanism connected for disabling the generationand embedding of low resolution image identification tags within thelegacy compatible digital images. Russ-should specifyconnections/location to elements.
 7. The scanning system adaptorapparatus of claim 5 further including a new feature disabling mechanismthat enables disabling of the generation and embedding of low resolutionimage identification tags within the legacy compatible digital images.8. A camera upgrade apparatus for use in repairing or upgrading ascanning and sorting system by replacing a legacy camera originallywithin the system, the scanning and sorting system useful for performinga sorting task such as the scanning and sorting a large plurality ofmail items, each mail item with an address label that is utilized as abasis for order of the sorting, the scanning and sorting systemincluding legacy image processing equipment for processing imagesreceived from the legacy camera in a legacy data format and resolution,the camera upgrade apparatus comprising: a) a new higher resolutioncamera for the scanning of input mail items to be sorted, the new higherresolution camera providing higher resolution images than the originallegacy camera; and system adaptor apparatus including: b) an imageformat conversion apparatus coupled to the new higher resolution camerafor converting a plurality of the higher resolution images to aplurality of legacy compatible images in a reduced resolution dataformat, the reduced resolution data format being both electricallycompatible and data format compatible for reception and processing bythe legacy image data processing equipment in the scanning and sortingsystem; and, c) one or more legacy adaptor connectors connected fortransferring legacy compatible images from the image format conversionapparatus to the legacy image processing system.
 9. The camera upgradeapparatus of claim 8 further including tag generating apparatus thatgenerates and embeds within each of a plurality of the legacy compatibleimages a low resolution image identification tag that uniquelyidentifies each of the plurality of legacy compatible digital images.10. The camera upgrade apparatus of claim 8 further including a thirdconnection providing as output higher resolution output data, the higherresolution output data directly related or equivalent to the higherresolution image data received from the higher resolution camera. 11.The camera upgrade apparatus of claim 8 further including a thirdconnector connected for providing as output from the scanning systemadaptor apparatus, the captured higher resolution images of scannedinput items for subsequent processing by new image processing equipment.12. The camera upgrade apparatus of claim 9 further including: a) a taggenerating apparatus that generates a plurality of higher resolutionimage identification tags that relates or associates one or more of theplurality of the higher resolution images with corresponding one or moreof the legacy compatible digital images, each legacy compatible digitalimage including an embedded low resolution image identification tag;and, b) one or more further connectors connected for providing as outputthe captured higher resolution images of scanned input items receivedfrom the frame capture apparatus, and their higher resolution imageidentification tags received from the tag generating apparatus.
 13. Thecamera upgrade apparatus of claim 9 further including a mechanismconnected for disabling the generation and embedding of low resolutionimage identification tags within the legacy compatible digital images.14. The camera upgrade apparatus of claim 12 further including amechanism connected for disabling the generation and embedding of lowresolution image identification tags within the legacy compatibledigital images.
 15. A method of replacing or upgrading a legacy camerain an existing scanning system, the legacy camera including a legacycamera output, the existing scanning system including legacy imageprocessing equipment for processing images received from the legacycamera in a legacy data format and resolution, the method comprising thesteps of: a) installing in the existing system in place of the legacycamera, a new camera, the new camera for providing scanned item imagesof items provided as input to the scanning system, the scanned itemimages being at a higher resolution or different data format than thosepreviously provided by the legacy camera; b) installing in the existingsystem a new camera upgrade adaptor apparatus, the upgrade adaptorapparatus including translator apparatus for conversion of scanned itemimages to adapted legacy output images, the adapted legacy output imagesbeing provided on an adapted output connector made compatible, by thetranslator apparatus, in data format and in electrical format forconnection in place of an is output from the original legacy camera;and, c) connecting the new camera to the upgrade adaptor apparatus; d)connecting the adapted output connector of the upgrade adaptor apparatusto the legacy image processing equipment in place of the originalconnection from the legacy camera output.
 16. The method of claim 15further comprising operatively connecting a tag generating apparatuswith the new camera ______, the tag generating apparatus generates andembeds within each of a plurality of the adapted legacy output images alow resolution image identification tag that identifies each of theplurality of adapted legacy output images.
 17. A method of replacing orupgrading a legacy camera in an existing scanning system, the existingscanning system including legacy image processing equipment, the legacycamera originally including an original legacy camera output connectedin the scanning system to the legacy image processing equipment andproviding data through that connection in a legacy data format andresolution, the legacy image processing equipment for processing imagesreceived from the legacy camera and producing legacy controls andscanned image data as output, these outputs useful for controlling otherequipment such as a sorter, the method of replacing or upgrading thelegacy camera comprising the steps of: a) removing the legacy camerafrom the existing scanning system; b) installing in the existing systemin place of the legacy camera, a new camera apparatus, the new cameraapparatus including: i) a higher resolution camera for providing scanneditem images of items provided as input to the scanning system, thescanned item images being at a higher resolution than those previouslyprovided by the legacy camera; ii) a translator apparatus, thetranslator apparatus for conversion of the scanned item images at thehigher resolution to form adapted low resolution output images, theadapted low resolution output images being provided on an adapted lowresolution output connector and made compatible, by the translatorapparatus, in data format and in electrical format for connection to thelegacy image processing equipment in place of the original legacy cameraoutput; and, c) connecting the adapted low resolution output connectorof the new camera apparatus to the legacy image processing equipment inplace of the original connection from the legacy camera.
 18. The methodof claim 17 with the new camera apparatus further including taggenerating apparatus that generates and embeds within each of aplurality of the adapted low resolution output images a low resolutionimage identification tag that identifies each of the plurality ofadapted low resolution output images.
 19. A scanning system adaptorapparatus for use in repairing or upgrading a scanning and sortingsystem by replacing a legacy camera originally within the scanning andsorting system with a new camera, the scanning and sorting system usefulfor performing a sorting task such as the scanning and sorting a largeplurality of items to be scanned and sorted, each item with an addresslabel that is utilized as a basis for order of the sorting, the sortingequipment including legacy image processing equipment for processinglegacy format images sent from the legacy camera in a legacy data formatand resolution, the scanning system adaptor apparatus comprising: a) afirst connector providing for connection of the new camera to theadaptor apparatus and for providing through this connection image datafrom the new camera to the adaptor apparatus; c) an image formatconversion apparatus for converting the image data received from the newcamera into legacy compatible images, the format of the legacycompatible images being compatible for processing by the legacy imagedata processing equipment; and, c) a second connector for connection ofthe adaptor apparatus to the legacy image processing system and enablingsending of the legacy compatible images from the adaptor apparatus tothe legacy image processing system.
 20. A camera upgrade apparatus foruse in repairing or upgrading a scanning and sorting system by replacingan original legacy camera originally within the system, the scanning andsorting system useful for performing a sorting task such as the scanningand sorting a large plurality of mail items, each mail item with anaddress label that is utilized as a basis for order of the sorting, thescanning and sorting system including legacy image processing equipmentfor processing images received from the legacy camera in a legacy dataformat and resolution, the camera upgrade apparatus comprising: a) a newcamera for the scanning of input mail items to be sorted, the new cameraproviding images in a new data format different than the original legacycamera; and system adaptor apparatus including: b) an image formatconversion apparatus coupled to the new camera for converting aplurality of the images in the new data format to a plurality of legacycompatible images with a data format being both electrically compatibleand data format compatible for reception and processing by the legacyimage data processing equipment in the scanning and sorting system; and,c) one or more legacy adaptor connectors connected for transferringlegacy compatible images from the image format conversion apparatus tothe legacy image processing system.
 21. A method of replacing orupgrading a legacy camera in an existing scanning system, the legacycamera including a legacy camera output, the existing scanning systemincluding legacy image processing equipment for processing imagesreceived from the legacy camera in a legacy data format and resolution,the method comprising the steps of: a) installing a new camera in theexisting system in place of the legacy camera, the new camera forproviding scanned item images of items provided as input to the scanningsystem, the new camera providing images in a new data format which isnot the same as the legacy data format; b) installing in the existingsystem a new camera upgrade adaptor apparatus, the upgrade adaptorapparatus including translator apparatus for conversion of scanned itemimages in the new data format to adapted legacy output images, theadapted legacy output images being provided on an adapted outputconnector made compatible, by the translator apparatus, in data formatand in electrical format for connection in place of an output from theoriginal legacy camera; and, c) connecting the new camera to the upgradeadaptor apparatus; d) connecting the adapted output connector of theupgrade adaptor apparatus to the as legacy image processing equipment inplace of the original connection from the legacy camera output.
 22. Amethod of replacing or upgrading a legacy camera in an existing scanningsystem, the existing scanning system including legacy image processingequipment, the legacy camera originally including an original legacycamera output connected in the scanning system to the legacy imageprocessing equipment and providing data through that connection in alegacy data format and resolution, the legacy image processing equipmentfor processing images received from the legacy camera and producinglegacy controls and scanned image data as output, these outputs usefulfor controlling other equipment such as a sorter, the method ofreplacing or upgrading the legacy camera comprising the steps of: a)removing the legacy camera from the existing scanning system; b)installing in the existing system in place of the legacy camera, a newcamera apparatus, the new camera apparatus including: i) a replacementcamera for providing scanned item images of items provided as input tothe scanning system, the scanned item images being provided in a newimage format than those previously provided by the legacy camera; ii) atranslator apparatus, the translator apparatus for conversion of thescanned item images in the new image format from the replacement camerato form adapted output images, the adapted output images being providedon an adapted output connector and made compatible, by the translatorapparatus, in data format and in electrical format for connection to thelegacy image processing equipment in place of the original legacy cameraoutput; and, c) connecting the adapted output connector of the newcamera apparatus to the legacy image processing equipment in place ofthe original connection from the legacy camera.
 23. A method ofoperating a legacy camera in an existing scanning system, the existingscanning system including legacy image processing equipment, the legacycamera originally including an original legacy camera output connectedin the scanning system to the legacy image processing equipment andproviding data through that connection in a legacy data format andresolution, the legacy image processing equipment for processing imagesreceived from the legacy camera and producing legacy controls andscanned image data as output, these outputs useful for controlling otherequipment such as a sorter, the method of replacing or upgrading thelegacy camera comprising the steps of: a) operating the existingscanning system with a new camera apparatus in place of the legacycamera, the new camera apparatus including: i) a replacement camera forproviding scanned item images of items provided as input to the scanningsystem, the scanned item images being provided in a new image formatthan those previously provided by the legacy camera; ii) a translatorapparatus, the translator apparatus for conversion of the scanned itemimages in the new image format from the replacement camera to formadapted output images, the adapted output images being provided on anadapted output connector and made compatible, by the translatorapparatus, in data format and in electrical format for connection to thelegacy image processing equipment in place of the original legacy cameraoutput; and, b) transferring data or signals over the adapted outputconnector of the new camera apparatus to the legacy image processingequipment